Adapting the stages of implementation completion to an evidence-based implementation strategy: The development of the NIATx stages of implementation completion.

Background: Dissemination and implementation frameworks provide the scaffolding to explore the effectiveness of evidence-based practices (EBPs) targeting process of care and organizational outcomes. Few instruments, like the stages of implementation completion (SIC) examine implementation fidelity to EBP adoption and how organizations differ in their approach to implementation. Instruments to measure organizational competency in the utilization of implementation strategies are lacking. Method: An iterative process was utilized to adapt the SIC to the NIATx implementation strategies. The new instrument, NIATx-SIC, was applied in a randomized controlled trial involving 53 addiction treatment agencies in Washington state to improve agency co-occurring capacity. NIATx-SIC data were reported by state staff and external facilitators and through participating agency documentation. Proportion and duration scores for each stage and phase of the NIATx-SIC were calculated for each agency. Competency was assessed using the NIATx fidelity tool. Comparisons of proportion, duration, and NIATx activities completed were determined using independent sample t-tests by agency competency level. Results: The NIATx-SIC distinguished between agencies achieving competency (n = 23) and those not achieving competency (n = 26). Agencies achieving competency completed a greater proportion of implementation phase activities and had a significantly longer Stage 7 duration. These agencies participated in significantly more individual and group coaching calls, attended more in-person meetings, implemented more change projects, and spent approximately 64 more days, on average, engaging in all NIATx activities. Conclusions: Organizational participation in dissemination and implementation research requires a significant investment of staff resources. The inability of an organization to achieve competency when utilizing a set of implementation strategies waste an opportunity to institutionalize knowledge of how to apply implementation strategies to future change efforts. The NIATx-SIC provides evidence that competency is not an attribute of the organization but rather a result of the application of the NIATx implementation strategies to improve agency co-occurring capacity. Trial Registration: ClinicalTrials.gov, NCT03007940. Registered January 2, 2017, https://clinicaltrials.gov/ct2/show/NCT03007940.

Access to integrated services for persons with co-occurring substance use and mental health disorders is a long-standing behavioral health problem. Evidence-based practices (EBPs) that focus on patient needs are effective in improving care for persons with co-occurring disorders. The stages of implementation completion (SIC) is a measure that assesses the process that organizations go through when implementing a new EBP and can be used to compare differences between organizations in their fidelity to recommended processes. To implement, organizations use specified strategies to integrate EBP into the care process. These strategies require a significant investment of staff resources. When organizations struggle to achieve competency with a set of implementation strategies, resources are wasted impacting the ability to use the strategies in future change efforts. As such, it is critical to measure organizational efforts to achieve competency, but instruments to do so are lacking. The SIC was adapted for a proven implementation strategy, NIATx, to address this gap. The NIATx strategy provides outside support and coaching to facilitate the implementation of a new EBP. Results from this study indicated that the NIATx-SIC could distinguish between addiction treatment agencies that applied NIATx implementation strategies with competency, versus those that did not, in the context of a multilevel randomized control trial. Study results provide evidence for the utility of adapting the SIC to specific implementation strategies and the benefit that the NIATx-SIC could provide for similar studies involving the use of NIATx to implement EBPs.

The relative value of Pre-Implementation stages for successful implementation of evidence-informed programs.

BACKGROUND: Most implementations fail before the corresponding services are ever delivered. Measuring implementation process fidelity may reveal when and why these attempts fail. This knowledge is necessary to support the achievement of positive implementation milestones, such as delivering services to clients (program start-up) and competency in treatment delivery. The present study evaluates the extent to which implementation process fidelity at different implementation stages predicts achievement of those milestones. METHODS: Implementation process fidelity data-as measured by the Stages of Implementation Completion (SIC)-from 1287 implementing sites across 27 evidence-informed programs were examined in mixed effects regression models with sites nested within programs. Implementation process fidelity, as measured by the proportion of implementation activities completed during the three stages of the SIC Pre-Implementation phase and overall Pre-Implementation (Phase 1) and Implementation (Phase 2) proportion scores, was assessed as a predictor of sites achieving program start-up (i.e., delivering services) and competency in program delivery. RESULTS: The predicted probability of start-up across all sites was low at 35% (95% CI [33%, 38%]). When considering the evidence-informed program being implemented, that probability was nearly twice as high (64%; 95% CI [42%, 82%]), and 57% of the total variance in program start-up was attributable to the program. Implementation process fidelity was positively and significantly associated with achievement of program start-up and competency. The magnitude of this relationship varied significantly across programs for Pre-Implementation Stage 1 (i.e., Engagement) only. Compared to other stages, completing more Pre-Implementation Stage 3 (Readiness Planning) activities resulted in the most rapid gains in probability of achieving program start-up. The predicted probability of achieving competency was very low unless sites had high scores in both Pre-Implementation and Implementation phases. CONCLUSIONS: Strong implementation process fidelity-as measured by SIC Pre-Implementation and Implementation phase proportion scores-was associated with sites' achievement of program start-up and competency in program delivery, with early implementation process fidelity being especially potent. These findings highlight the importance of a rigorous Pre-Implementation process.

Bringing Evidence-Based Interventions into the Schools: An Examination of Organizational Factors and Implementation Outcomes.

Although schools are one of the largest providers of behavioral health services for youth, many barriers exist to the implementation of evidence-based interventions in schools. This study used the Stages of Implementation Completion (SIC) to examine school-based implementation outcomes for a computer-assisted cognitive behavioral therapy intervention for anxious youth. Organizational factors and predictors of program startup also were examined. Results indicated that the SIC detected implementation variability in schools and suggested that spending more time completing pre-implementation activities may better prepare schools for active implementation of program delivery. Furthermore, proficiency emerged as a potentially important organizational factor to examine in future school-based implementation research.

Rates of sustainment in the Universal Stages of Implementation Completion.

BACKGROUND: Sustainment is a desirable outcome of implementation, but its precise definition remains unclear, contributing to the difficulty of identifying a generalized rate of sustainment. Several studies and reviews on the topic differ on both definition and levels of analysis. Furthermore, methodological limitations might have influenced the results, including the unknown quality with which some interventions were delivered. The Universal Stages of Implementation Completion (UniSIC) is a standardized measurement tool that tracks the implementation process and milestone completion across a wide range of real-world implementations-this provides a unique opportunity to identify a generalized rate of sustainment. METHODS: UniSIC data was captured from the SIC website on 27 September 2020 and included data from all sites (n = 1778) that had been tracked to date. Data were restricted to sites that achieved competency in program delivery, and thus had a newly adopted program worthy of sustainment. Dates and indicator variables of implementation activities were combined to form two alternate definitions of sustainment: sustained (start-up) was achieved if sites continued to deliver services 2 years past their program start-up date; sustained (competent) was achieved if sites continued to deliver services 2 years past their competence and/or certification date. Of sites eligible for inclusion based on these definitions (N = 208), descriptive analyses were conducted to determine a rate of sustainment for all programs that successfully started a program. These definitions were also applied to a combined sample for a general rate of sustainment among all sites. Rates of competency among both a sample of sites that started up and a combined sample were also identified. RESULTS: The rate of competence was 58.5% and the rate of sustained (start-up) was 37.1%, while the rate of sustained (competent) was 25.1%. The rates of competence and sustainment among the combined samples were far lower: 15.6% for competence, 6.8% for sustained (start-up), and 4.4% for sustained (competent). CONCLUSIONS: These identified rates of sustainment are accurate initial estimates of sustainment of community-based practices, or in general. Future research on rates of sustainment should carefully define measures of sustainment and be transparent about the real-world conditions on which analyses are centered.

Motivations for Prescription Drug Misuse Related to Mental Health Problems in Adults.

BACKGROUND: Prescription drug misuse (PDM) is a significant public health problem associated with mental health symptoms. OBJECTIVES: This project investigates the connections between PDM motivations and mental health to inform intervention efforts. METHODS: Using nationally representative adult data from the 2016-2018 National Survey on Drug Use and Health (N = 128,205; 53% female) this project investigated which motivations for misuse are related to past-year mental health problems including any mental illness, serious mental illness, major depressive episode, and suicidal thoughts. Complex samples logistic regression models of the main motivation of PDM for each mental health problem were conducted separately for each prescription drug class (i.e., opioids, tranquilizers, sedatives, and stimulants) while controlling for demographic characteristics. RESULTS: Adults that reported PDM were more likely than those with no PDM to endorse past year mental health problems. Compared to those that reported PDM of other medications, those misusing prescription opioids and tranquilizers to help with emotions and misusing sedatives to "relax or relieve tension" were more likely to have all categories of mental health problems. Those that misused prescription stimulants to "help study" had lower odds of all mental health problems. CONCLUSIONS: While there were differences based on prescription drug class, a range of motivations increased adults' likelihood to have mental health problems and common themes were found across drug classes. While causality is still undetermined, prevention and intervention efforts that are multifaceted and individualized, while broadly providing adults with other ways to cope with negative emotions are likely to help reduce PDM.

Meeting the Needs of Families Involved in the Child Welfare System for Parental Substance Abuse: Outcomes From an Effectiveness Trial of the Families Actively Improving Relationships Program.

Limited evidence-based practices exist to address the unique treatment needs of families involved in the child welfare system with parental substance abuse. Specifically, parental opioid and methamphetamine abuse have increased over the last decade, with associated increases of families reported to the child welfare system. The Families Actively Improving Relationships (FAIR) program was developed to address the complexities of these families. Evidence-based strategies to address the interrelated needs of parents-including substance abuse and mental health treatment, parent skills training, and supportive case management to improve access to ancillary needs-are integrated in an intensive community outpatient program. This study examined the clinical effectiveness of FAIR when delivered in a Medicaid billable outpatient clinic. Parents (n = 99) were randomized either to the immediate FAIR condition or to the Waitlist (WL) condition, using a dynamic wait-listed design, with all parents provided the opportunity to eventually receive FAIR. Outcomes show statistically and clinically significant reductions in parental opioid and methamphetamine use, mental health symptoms, and parenting risk, and improvements in stability in parents receiving FAIR. Providing services to families who require travel in excess of 20 miles for sessions has challenging implications for program costs under a Medicaid structure. Study outcomes highlight the need for policies to support funding of intensive family-based programs.

An Exploratory Study of a Training Team-Coordinated Approach to Implementation.

Background: It is now widely understood that successful implementation of evidence-based treatments is facilitated by several favorable conditions (e.g., community buy-in, invested agency leadership). However, strategies for supporting agencies in promoting these conditions have been examined to a lesser extent. In this exploratory study, the implementation support procedures of Parenting with Love and Limits (PLL), an evidence-informed family treatment for child/adolescent behavior problems in which the training team follows structured procedures to help coordinate implementation support activities, are illustrated, and their preliminary effectiveness examined. Methods: PLL documents and communication records between PLL and n = 23 sites across the U.S. that initiated PLL pre-implementation activities were reviewed. In addition, implementation activities completed for each agency were entered into the Stages of Implementation Completion (SIC) dashboard. Results: The prescriptive nature of the PLL implementation support protocol was illustrated through descriptions of procedural documents and case examples. Quantitative analyses revealed that, among the 23 sites that began pre-implementation, 9 discontinued, with a trend toward sites in metropolitan areas being more likely to discontinue than those in less populous areas. In addition, the 14 sites that launched PLL demonstrated a high amount of consistency in activities, with sites in the sustainability phase completing an average of 86% of implementation behaviors. Conclusions: Training team-coordination of implementation activities may be one promising approach for supporting agencies in completing tasks to facilitate successful uptake of evidence-supported interventions. In turn, sustained implementation of evidence-supported treatments could allow communities to benefit from practice innovations to a greater extent.

Scaling Implementation of Collaborative Care for Depression: Adaptation of the Stages of Implementation Completion (SIC).

Tools to monitor implementation progress could facilitate scale-up of effective treatments. Most treatment for depression, a common and disabling condition, is provided in primary care settings. Collaborative Care Management (CoCM) is an evidence-based model for treating common mental health conditions, including depression, in this setting; yet, it is not widely implemented. The Stages of Implementation Completion (SIC) was adapted for CoCM and piloted in eight rural primary care clinics serving adults challenged by low-income status. The CoCM-SIC accurately assessed implementation effectiveness and detected site variations in performance, suggesting key implementation activities to aid future scale-ups of CoCM for diverse populations.

A Mixed Methods Study of the Stages of Implementation for an Evidence-Based Trauma Intervention in Schools.

A mixed methods study was conducted to examine the implementation process of 26 urban school-based mental health clinics that took part in a training and implementation support program for an evidence-based school trauma intervention. Implementation process was observed using the Stages of Implementation Completion (SIC) measure. Qualitative interviews were conducted with clinic leaders in order to gain insight into clinic processes related to the SIC. Results showed that almost all of the clinics engaged in some activities related to pre-implementation (engagement, feasibility, and readiness), but only 31% of the sites formally started delivering the program to youth. Completing more pre-implementation activities, particularly those related to readiness, predicted program start-up. Qualitative analysis comparing those that implemented the program to those that did not revealed critical differences in decision-making processes, leadership strategies, and the presence of local champions for the program. This study documented the patterns of clinic behavior that occurs as part of large-scale training efforts, suggests some unique challenges that occur in schools, and highlights the importance of engaging in particular implementation activities (i.e., readiness planning, stakeholder consensus and planning meetings) as part of program start-up. Findings indicate that pre-implementation and readiness-related consultation should be employed as part of broad-scale implementation and training efforts.

ZFIN: enhancements and updates to the Zebrafish Model Organism Database.

ZFIN, the Zebrafish Model Organism Database, http://zfin.org, serves as the central repository and web-based resource for zebrafish genetic, genomic, phenotypic and developmental data. ZFIN manually curates comprehensive data for zebrafish genes, phenotypes, genotypes, gene expression, antibodies, anatomical structures and publications. A wide-ranging collection of web-based search forms and tools facilitates access to integrated views of these data promoting analysis and scientific discovery. Data represented in ZFIN are derived from three primary sources: curation of zebrafish publications, individual research laboratories and collaborations with bioinformatics organizations. Data formats include text, images and graphical representations. ZFIN is a dynamic resource with data added daily as part of our ongoing curation process. Software updates are frequent. Here, we describe recent additions to ZFIN including (i) enhanced access to images, (ii) genomic features, (iii) genome browser, (iv) transcripts, (v) antibodies and (vi) a community wiki for protocols and antibodies.